Moderate Deviations Asymptotics for Streaming Compression of Correlated Sources
نویسندگان
چکیده
In this paper, we consider the problem of blockwise streaming compression of a pair of correlated sources, which we term streaming Slepian-Wolf coding. We study the moderate deviations regime in which the rate pairs of a sequence of codes converges, along a straight line, to various points on the boundary of the Slepian-Wolf region at a speed slower than the inverse square root of the blocklength n, while the error probability decays subexponentially fast in n. Our main result focuses on directions of approaches to corner points of the Slepian-Wolf region. It states that for each correlated source and all corner points, there exists a non-empty subset of directions of approaches such that the moderate deviations constant (the constant of proportionality for the subexponential decay of the error probability) is enhanced (over the non-streaming case) by at least a factor of T , the block delay of decoding symbol pairs. We specialize our main result to the setting of lossless streaming source coding and generalize this result to the setting where we have different delay requirements for each of the two source blocks. The proof of our main result involves the use of various analytical tools and amalgamates several ideas from the recent information-theoretic streaming literature. We adapt the so-called truncated memory idea from Draper and Khisti (2011) and Lee, Tan and Khisti (2015) to ensure that the effect of error accumulation is nullified in the limit of large blocklengths. We also adapt the use of the so-called minimum empirical suffix entropy decoder which was used by Draper, Chang and Sahai (2014) to derive achievable error exponents for streaming Slepian-Wolf coding. Index Terms Slepian-Wolf coding, Streaming compression, Moderate deviations, Truncated memory, Weighted empirical suffix-entropy decoder
منابع مشابه
On Error Exponents and Moderate Deviations for Lossless Streaming Compression of Correlated Sources
We derive upper and lower bounds for the error exponents of lossless streaming compression of two correlated sources under the blockwise and symbolwise settings. We consider the linear scaling regime in which the delay is a scalar multiple of the number of symbol pairs of interest. We show that for rate pairs satisfying certain constraints, the upper and lower bounds for the error exponent of b...
متن کاملRefined Asymptotics for Rate-Distortion using Gaussian Codebooks for Arbitrary Sources
The rate-distortion saddle-point problem considered by Lapidoth (1997) consists in finding the minimum rate to compress an arbitrary ergodic source when one is constrained to use a random Gaussian codebook and minimum (Euclidean) distance encoding is employed. We extend Lapidoth’s analysis in several directions in this paper. Firstly, we consider refined asymptotics. In particular, when the sou...
متن کاملNon-Asymptotic Converse Bounds and Refined Asymptotics for Two Lossy Source Coding Problems
In this paper, we revisit two multi-terminal lossy source coding problems: the lossy source coding problem with side information available at the encoder and one of the two decoders, which we term as the Kaspi problem (Kaspi, 1994), and the multiple description coding problem with one semi-deterministic distortion measure, which we refer to as the Fu-Yeung problem (Fu and Yeung, 2002). For the ...
متن کاملDiscrete Lossy Gray-Wyner Revisited: Second-Order Asymptotics, Large and Moderate Deviations
In this paper, we revisit the discrete lossy Gray-Wyner problem. In particular, we derive its optimal second-order coding rate region, its error exponent (reliability function) and its moderate deviations constant under mild conditions on the source. To obtain the second-order asymptotics, we leverage the properties of an appropriate generalization of the conditional distortion-tilted informati...
متن کاملModerate Deviation Asymptotics for Variable-Length Codes with Feedback
We consider data transmission across discrete memoryless channels (DMCs) using variable-length codes with feedback. We consider the family of such codes whose rates are ρN below the channel capacity C, where ρN is a positive sequence that tends to zero slower than the reciprocal of the square root of the expectation of the (random) blocklength N . This is known as the moderate deviations regime...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1604.07151 شماره
صفحات -
تاریخ انتشار 2016